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Abstract. This paper presents results of a questionnaire focused on investigating students’ confi¬ 
dence and behavioral intention in the area of programming, particularly that of structures, problem 
solving, and programming commands (Conditional - Loop). Responses from 116 1 st year students 
regarding informatics were used. The results indicate that the engagement with programming logic 
yields a positive impact on students’ confidence and acceptance. In addition, all the measured fac¬ 
tors are related relatively strongly. Our findings demonstrate that students’ prior direction (at Ly¬ 
ceum) has a significant impact on their Confidence for using Programming Commands (CPC) and 
Confidence for using Data Structures (CDS); however, prior direction does not have any impact on 
learners Problem Solving Confidence (PSC) and Behavioral Intention (BI) for programming. In the 
conclusion, several issues regarding the courses of programming are discussed. 

Keywords: adoption, algorithms, curriculum, data structures, Greece, programming, problem 
solving. 


1. Introduction 

For many years computing has been included in the curriculum as a distinct discipline 
in secondary education on a global scale. Computing focuses on how computers work 
(hardware) and how to program them (programming and software development), whereas 
ICT (Information and Communication Technology) is focused on how to use computers. 


This work was carried out during the tenure of an ERCIM “Alain Bensoussan” Fellowship programme. 
The research leading to these results has received funding from the European Union Seventh Framework 
Programme (FP7/2007-2013) under grant agreement no 246016. 
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Specifically, programming with an emphasis on algorithms as a methodology of thought 
appears to be an important objective in students’ education and aiming, among other things, 
in their preparation for tertiary education (Eliasson et al., 2006; Wilson and Shrock, 2001). 

Successful programming largely depends on its acceptance by potential university 
students or by high school students. Several models and theories have been used to ad¬ 
dress the issue of acceptance. The Unified Theory of Acceptance and Use of Technology 
(UTAUT) (Venkatesh et al, 2003) is one of the most widely and successfully used. Other 
researchers have empirically explained (using UTAUT or its initial form of TAM) several 
issues regarding students’ acceptance. In this light, we aim to measure empirically the 
acceptance of programming using the construct of Behavioral Intention (BI) adopted by 
UTAUT. We used four items to measure the BI construct, collected based on the literature 
review of empirical studies (Ngai et al., 2007; Sanchez and Huero, 2010). 

Additionally, the content of the curriculum largely defines the knowledge that stu¬ 
dents are expected to gain from a course in algorithms and programming. According 
to various curricula (Hubwieser et al., 2011; Stephenson et al., 2005; Tucker et al, 
2004), the purpose of a course in algorithms and programming is to foster analytical 
and synthetic thought in students, to develop their creativity and imagination in design, 
to foster their austerity and clarity of formulation, to develop their methodology skills, 
and finally to enable them to proceed to problem solving using programming knowl¬ 
edge (Vakali et al., 1999). 

In particular, it is essential for students, through a course in algorithms and program¬ 
ming, to be able to (Tucker et al., 2004; Cassel et al, 2008; Greek Pedagogical Institute, 
1997): 

A) Acquire knowledge regarding problem analysis. 

B) Solve algorithmic problems using structures of sequence, conditional, loop. 

C) Select data Structures when necessary. 

The remainder of the paper is organized as follows: in the next section, we present the 
overview of the state of programming courses in Greece. In the third section, we give a 
short literature review of the framework of programming courses on other countries and 
the added value of these courses. The fourth section outlines the research hypotheses, fol¬ 
lowed by the applied research approach, as well as the datasets and respective measures. 
The sixth section presents the empirical findings derived, while the last section of the 
paper draws the conclusions of this research and discusses several implications and ideas 
for further research in the area. 


2. Overview 

In Greece, the teaching of Computing and ICT in secondary education is conducted by 
teachers holding at least an undergraduate degree in Computer Science, Computer En¬ 
gineering, or Applied Informatics. Secondary Education in Greece is divided into two 
cycles: compulsory lower secondary and non-compulsory upper secondary education. 
Compulsory lower secondary education is provided in Gymnasium, while non-compul¬ 
sory upper secondary education is provided in one of two types of schools: the General 
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Lyceum (GL) and Vocational Lyceum (EPAL). Parallel to these full-time day schools are 
evening secondary schools. The duration of studies in Gymnasium, both day and eve¬ 
ning, is three (3) years. The duration of studies in a GL is three (3) years, unless the GL 
operates as an evening school, in which case duration is four (4) years. Computing and 
ICT courses are mandatory during Gymnasium years and aim to develop students’ skills 
in the use of ICT (operating systems, word processing, spreadsheets, image processing 
etc). In the third year of Gymnasium, students acquire fundamental algorithmic and pro¬ 
gramming skills within a LOGO based environment. As part of a pilot programme, ICT 
courses have also been introduced in primary education for two teaching hours per week. 
In both day and evening GL, ICT has been taught as an elective or direction course since 
1999. Finally, EPAL offers an Information Science sector with the following specializa¬ 
tion: “System, Applications and Computer Networks’ Support’’. Thus, besides mandatory 
education (primary and lower secondary), students in all the classes of Lyceum can select 
certain ICT from a wide range of various subjects. In the last two classes of General 
Lyceum, students select one of three directions, (technological, scientific, or theoretical). 
If students in the last grade select the technological direction, they attend a course in 
algorithms and programming, entitled “Application Development in a Programming En¬ 
vironment”, for which they are assessed through national exams. Accordingly, in EPAL, 
if students select to specialize in ICT, they attend certain ICT courses. From these, they 
are assessed through national exams in the course of Structured Programming. The grade 
acquired in this examination is part of the consideration used in selecting students for 
admission in higher education programmes (Eyrydice, 2009). 

Some of the goals of these two courses are the same. Both of them focus on the al¬ 
gorithmic approach and on the development of problem-solving skills in a programming 
environment; however, in the course of Structured Programming, students also deal with 
programming techniques and specific programming language (Pascal). Nevertheless, the 
overall aim ofboth courses is to develop analytical and synthetic thinking, acquire method¬ 
ological skills, and be able to solve simple problems within a programming environment. 
Many basic algorithmic and programming concepts, such as conditions, expressions, and 
logical reasoning, are fundamentals of general knowledge and skills to be acquired in gen¬ 
eral education; most of these concepts are not included in other disciplines. 

The curriculum states that this subject must be taught (at least partially) in a computer 
lab. The Greek Pedagogical Institute (Ministry of Education) has certified specific Edu¬ 
cational Software to support the lab work, especially for the course of Application De¬ 
velopment in a Programming Environment, while the course of Structured Programming 
features the environment of Pascal. 

After the exams, on the basis of a) the total grades received, b) the courses examined, 
and c) their preferences, students enter tertiary education. Their admission is based upon 
certain rules, according to which their previous area of study is not the primary criterion 
for admission. Thus, it is possible for a student to be admitted in a Department of In¬ 
formatics in tertiary education without having attended the course of either Application 
Development in a Programming Environment or Structured Programming accordingly. 

The course of Application Development in a Programming Environment has been 
taught in secondary education since 1999, while the course of Structured Programming 
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assessment at a national level has only recently started; however, no research has been 
conducted to draw conclusions contributing to the study of possible benefits from al¬ 
gorithmic courses, as well as the confidence of the students graduating from secondary 
education. 


3. The International Context 

Recent activity in countries such as USA, the United Kingdom, New Zealand, and South 
Korea display a growing awareness of the importance of rigorous computer science, spe¬ 
cifically programming education in schools. Consequently, we have seen serious efforts 
to introduce or to improve programming in schools. Reports conducted by (1) the Associ¬ 
ation for Computing Machinery (ACM) and the Computer Science Teachers Association 
(Wilson et al., 2010), and (2) ACM ITiCSE Working Group: Informatics in Secondary 
Education (Hubwieser et al., 2011) revealed that CS courses face problems regarding 
their lack of exposure and motivators, which are quite essential. During the keynote pre¬ 
sentation of the last International Conference on Informatics in Schools (IS SEP), the 
growing awareness of the importance of rigorous computer science and programming 
education became clear, as well as how this awareness can contribute to the successful, 
self-responsive, and self-deciding life in the modern world (Hubwieser, 2013). 

Research in many countries, shows that students’ prior engagement with program¬ 
ming and algorithmic courses results in better achievements in programming at tertiary 
education (Taylor and Mounfield, 1991, 1994; Hagan and Markham, 2000; Holden and 
Weeden, 2004). In the students’ transition between secondary and tertiary education, it 
seems that students who possess experience in programming have significant advantages 
over the others (Clark and Boyle, 2005). 

Cantwell-Wilson and Shrock, (2001) indicated that university students’ “comfort lev¬ 
el” in programming and computer science is highly related with their engagement with 
similar courses in their secondary education. In alignment with that, university students 
who have not participated in programming courses in secondary education perceive dif¬ 
ficulty during the introductory courses of IT and CS department. Brown et al., (1997) 
indicated that “students who find the course difficult are intimidated by seeing other stu¬ 
dents who have prior programming experience completing the assignments very quickly” 
(Brown et al., 1997, p. 2). 

On the same line, Dagiene and Jevsikova (2012) argue that the purpose of program¬ 
ming courses in secondary education is to motivate students to choose informatics in their 
further studies. As such, the highlight of Taylor and Mounfield’s research (1989) regard¬ 
ing the precondition of programming course in order to help departments to maintain 
strong, healthy undergraduate programs is still timely. According to Ramalingam et al., 
(2004) prior experience in programming contributes to increasing students’ self-efficacy, 
in addition to affecting their perceptions for their capabilities. 

Hence, the existence ofth s Application Development in a Programming Environment 
course in secondary education and the lack of relevant research motivate us to investigate 
the following research hypotheses regarding the impact of students’ engagement with 
programming course on their secondary education. 
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4. Research Hypotheses 

We carried out an experiential study aiming to explore issues regarding a) the benefits that 
students gain from relevant courses, b) their confidence after completing relevant courses, 
and c) the acceptance of programming. 

Thus, we formulated the following hypotheses: 

• HI. Students ’direction (technological or scientific) influences their behavioral in¬ 
tention (BI) to use programming. 

• H2. Students’ direction (technological or scientific) influences their level ofprob¬ 
lem solving Confidence (PSC). 

• H3. Students ’ direction (technological or scientific) influences their confidence for 
using programming command (CPC). 

• H4. Students ’ direction (technological or scientific) influences their confidence for 
using data structures (CDS). 


5. Research Approach 

5.1. Sampling 

Our research approach included a survey composed of questions on demographics and 
education information (gender, direction, kind of education, grades) of the sample and 
on the constructs of BI, PSC, CPC and CDS as defined in Table 2. Questionnaires were 
distributed in two different Departments of Informatics in Greece. The surveys were 
conducted during the first two weeks of October 2010, before the start of courses. The 
final sample of respondents consisted of 116 1st year students. From the total of re¬ 
spondents, 64 (55.2%) were males, and 19 (16.4%) were females. The vast majority, 94 
(81.0%), of the respondents were educated in General Lyceum (GL), and 81 (69.8%) 
had followed the technological direction. In the Table 1 we present the detailed profiles 
of our sample. 


Table 1 

Students’ demographic profile 


Demographic Profile 


No 

% 

Gender 

Male 

64 

55.2% 


Female 

19 

16.4% 

Kind of Lyceum 

General Lyceum (GL) 

94 

81.0% 


General Evening Lyceum (GEL) 

2 

1.7% 


Vocational Lyceum (EPAL) 

15 

12.9% 


Vocational Evening Lyceum (EPAEL) 

3 

2.6% 

Direction 

Technological 

81 

69.8% 


Scientific 

17 

14.7% 


Theoretical 

1 

0.9% 


* We have some missing fields in our data 
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5.2. Measures 

A survey questionnaire was used in this study. It consisted of two sections; the first section 
required that participants provide their demographic and education information (gender, 
institution, direction, education), and the second section included items which measure 
the constructs of BI, CPS, CPC and CDS. Table 2 lists the questionnaire items adapted 
from previous studies to measure students’ perceptions and confidence. For all variables, 
5-point Likert scales were used to quantify the information. 


6. Research Findings 

Fornell and Larcker (1981) proposed three procedures to assess the convergent validity 
of any measure in a study: (1) composite reliability of each construct, (2) item reliability 
of the measure, and (3) the average variance extracted (AVE). 

First, we carried out an analysis of composite reliability and dimensionality to check 
the validity of the scale used in the questionnaire. Regarding the reliability of the scales, 
Cronbach’s (1951) a indicators’ was applied and inter-item correlations statistics for the 
items of the variable. According to Fornell and Larcker (1981) and Hair, et al. (2006), 
Cronbach’s a value greater than 0.7 indicates a high reliability. As we can see in Table 2, 
the result of the test revealed acceptable indices of internal consistency in the Bl (0.914), 
PSC (0.785), CPC (0.947), and CDS (0.926) of the students. 

At the next stage, we proceeded to evaluate the reliability of the measure. The reli¬ 
ability of an item was assessed by measuring its factor loading onto the underlying con¬ 
struct. All items exhibited factor loadings greater than 0.6, which is considered a good 
indicator of validity at the item level. The factor analysis identified four distinct factors; 
1) Behavioral Intention (BI), 2) Problem Solving Confidence (PSC), 3) Confidence for 
using Programming Commands (Conditional - Loop) (CPC), and 4) Confidence for using 
Data Structures (CDS) (Table 2). Together, the four factors accounted for 72.504 percent 
of the total variance. 

The third step for assessing the convergent validity is the average variance extracted 
(AVE); AVE measures the overall amount of variance that is attributed to the construct 
in relation to the amount of variance attributable to measurement error (Segars, 1997). 
Convergent validity is found to be adequate when the average variance extracted equals 
or exceeds 0.50 (Segars, 1997). 

After the factor identification, we used the average mean value of the items of each 
factor in order to measured students’ acceptance and confidence regarding the courses 
of programming. The levels of acceptance (BI=4.09/5) and confidence (PSC=3.79/5; 
CPC=3.97/5; CDS=3.49/5) are relatively high amongst surveyed students. 

In the Figure 1 (Fig. 1), the recognized factors are presented. 

Despite the fact that these factors arise from an orthogonal rotation and are separable 
in terms of item loadings, they are correlated (see Table 3). The Pearson correlations be¬ 
tween the factors suggest that all the factors identified are related relatively strongly. 
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Table 2 

Items and Summary of measurement scales 



Items 

Mean 

S.D. 

Loadings 

CR 

AVE 


I plan to cope up with programming in the 

4.053 

1.17 

.843 

.914 

0.73 

G 

O 

future. (Bit) 






"3 

I intent to continue programming in the 

4.129 

1.17 

.882 




future. (BI2) 






"3 

l-c 

I intent to cope up with programming 

4.052 

1.20 

.866 




routinely. (BI3) 






-G 

<U 

I expect my use of programming to continue 

4.113 

1.18 

.830 



CQ 

in the future. (BI4) 






Conf 

Ifeel confident in... 







Fully understanding the problems presented 

3.835 

0.93 

.701 

.785 

0.50 

O 

g 

to me (PSC1) 






■a 

Identifying the components of a problems 

3.687 

1.05 

.769 



O 

CJ 

(PSC2) 






60 

Analyzing a problem to other simpler ones 

3.948 

0.98 

.687 




(PSC3) 







Identifying the data provided for handling a 

3.974 

0.93 

.675 



J 

problem (PSC4) 






o 

1- 

Posing a problem, formulating it accurately 

3.526 

0.98 

.683 



Oh 

and completely (PSC5) 







Formulating the forms of conditional 

4.115 

1.23 

.742 

.947 

0.62 

G 

O 

statement if (CPC 1) 






"3 

Discerning the differences of the fonns of 

4.158 

1.17 

.847 



G 

o 

conditional statement if (CPC2) 






1 

Selecting the best form of conditional 

3.896 

1.22 

.784 



o 

G 

statement depending on the problem (CPC3) 






G 

cr 

Fonnulating the loop statement (CPC1) 

4.122 

1.17 

.810 



00 

Selecting the best loop statement (CPC2) 

3.783 

1.21 

.794 



=2 

Using the appropriate loop statement 

3.948 

1.10 

.791 



O 

G 

(CPC3) 






-a & 
2 

Composing algorithms which use all three 

3.800 

1.26 

.715 



§ ^ 

basic statements: sequence, conditional and 






U 1 

loop (CPC4) 







Deciding whether it is necessary to use an 

3.478 

1.32 

.761 

.926 

0.64 

5 

»H 

array (CDS 1 ) 






B 

o 

Selecting the formula of array (one- 

3.644 

1.42 

.844 




dimensional, two-dimensional, etc.) (CDS2) 






-5 

Entering, processing and printing the items 

3.687 

1.38 

.855 



a 

of an array (CDS3) 






<2 

Doing general exercises and exercises of 

3.509 

1.37 

.793 



o 

G 

searching and sorting using the structure of 






XS 

the array (CDS4) 






3 

O 

Defining the structures of the stack and queue 

3.113 

1.39 

.726 



CJ 

with the correspondent operations (CDS5) 
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Fig. 1. Average mean value of each factor based on its items. 


Table 3 

Pearson correlations between Factors (n = 116) 



Behavioral 

Intention 

Problem 

Solving 

Confidence 

Confidence 
for using 
Programming 
Commands 

Confidence 
for using 

Data 

Structures 

Behavioral Intention 

i 




Problem Solving Confidence 

.247" 

i 



Confidence for using Programming Commands 

.455" 

.447" 

i 


Confidence for using Data Structures 

.347" 

.391" 

.673" 

i 


**. Correlation is significant at the 0.01 level 


To examine the hypotheses H1-H4, we used the t-test method, including the one de¬ 
pendent variable (direction) and four independent variables (BI, PSC, CPC, CDS). As we 
can see from the outcome data in Table 4, students’ previous direction (in Lyceum) does 
not exhibit significant impact on BI, while PSC exhibits a highly significant impact on 
their CPC and CDS. This result provides support for hypotheses H3 and H4. 


Table 4 

Flypotheses testing using t-test method 



Mean (SD) 


t 

df 

Sign. 

Result 

Direct. 

Technological 

Scientific 





BI 

4.253 (0.95) 

3.956(1.07) 

1.144 

96 

.255 

i.d. 

PSC 

3.911 (0.67) 

3.859 (0.68) 

0.291 

96 

.772 

i.d. 

CPC 

4.342 (0.71) 

2.801 (1.24) 

7.052 

96 

.000* 

s.d. 

CDS 

3.919(0.92) 

2.459(1.26) 

5.552 

96 

.000* 

s.d. 


p<0.001; i.d.=insignificant difference s.d.=significant difference 
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♦ Technological 
■ Scientific 


Fig. 2. The influence of direction in “Confidence for using Programming Commands” 
and “Confidence for Data Structures”. 


These results provide strong support for the notable influence of “Direction” in learn¬ 
ers’ confidence. The Figure 2 (Fig. 2) clearly exhibits the impact of direction on learners 


CPC and CDS. 


7. Discussion 

Computer science is one of the most evolving sciences, and its applications appear in¬ 
creasingly in everyday activities of people. In recent years, the acquisition of various 
stimuli and knowledge of the principles of computer science, as expressed in a variety of 
courses (Gal-Ezer and Harel, 1999; Tucker, 2010; Ragonis, 2009) has occurred among 
increasingly younger students. One reason is that recent years’ students develop new rep¬ 
resentations different from those used in traditional classroom (Saeli et al., 2010). Thus, 
the development of algorithmic thinking pursued in targeted courses in secondary educa¬ 
tion helps students to develop up to date skills and competences that may not be possible 
to achieve in other subjects (Soloway, 1993). 

From the results it appears that secondary students who have obtained admission to a 
department of informatics of higher education and intend to deal with programming, state 
high confidence to solve problems, design algorithms, and use appropriate data structures 
when essential. 

Moreover, students of tertiary education who have attended the course of algorith¬ 
mic design as secondary students declare higher confidence than the students of tertiary 
education who have not enrolled in relevant courses. These findings match what Schulte 
and Magenheim (2005) found for students who previously attended computer literacy 
courses in secondary education; however, the different directions from which the students 
obtained admission to a department of informatics of higher education influences the 
teaching approach of the staff of the departments of informatics. As a result, it seems that 
the precondition of secondary education course on algorithmic and programming and the 
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successful evaluation of this knowledge before entrance into CS and IT departments can 
highly improve the quality and the studies on these departments. This is in accordance 
with Taylor and Mounfield (1989), who have indicated that it might have positive benefits 
if the students obtained admission to a department of informatics with the condition that 
they have already acquired knowledge of design algorithms. 

Another interesting finding is that the direction does not affect the confidence in 
problem solving (PSC) or Behavioral Intention (BI) in programming. Presumably, re¬ 
gardless of direction, most entrants declare that they want to study in a computer de¬ 
partment of tertiary education because they wish to evolve in programming (Fogler 
and LeBlanc, 2007). Moreover, confidence in problem solving is developed by solving 
problems in various areas (mathematics, science, etc.), which is therefore not related 
to direction. 

At the same time, it seems to be advantageous that the curriculum does not focus on 
a particular programming language during secondary education (Ginat, 2006). This high¬ 
lights the fact that different departments of informatics have different curriculum, which 
possibly deepen to specific and different programming languages. The focus on algo¬ 
rithm development, without students’ involvement with the techniques of programming 
languages, contribute to the development of critical thinking and problem solving skills, 
which has emerged globally as an important component of modern curricula. 

8. Conclusions and Further Research 

In this empirical study, we measured students’ acceptance and confidence regarding the 
courses of programming. The levels of acceptance and confidence are relatively high 
amongst students. Results show the advantage gained by tertiary education students, 
whose curriculum includes programming courses, and who had attended courses of Al¬ 
gorithms and Programming as secondary education students. On the basis of the above, 
one coidd argue that attending relevant courses in secondary education is beneficial and 
contributes to achievement in higher level courses in tertiary education. Nevertheless, 
a) being with students without prior knowledge of algorithms and programming and b) 
the absence of a research that would provide information regarding the academic level 
of freshmen from the tertiary institution viewpoint prevent safe conclusions. This study 
yields new questions as to whether a) the relevant education at a secondary level, besides 
the confidence that it offers to students, also leads to better academic performance, b) it 
is preferable for students’ training in algorithmic structures to be carried out in a com¬ 
mon programming language rather than other ways of developing algorithms, and c) the 
knowledge that students acquired from secondary education is the kind of knowledge that 
will support their university education. 

In Greek secondary education, there are several classes offering informatics and tech¬ 
nology curricula. Concerning our future research program, we aim to conduct large scale 
pre - post studies in order to identify differences among students attending technology, 
informatics, and programming courses and those who do not. Our main target is to identi¬ 
fy cognitive, performance and motivational differences affected by the involvement with 
informatics and programming courses. 
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Studentq palankumo algoritmavimo ir programavimo mokymui 
rodikliq matavimas: informatikos mokymo Graikijos vidurineje 
mokykloje jtaka 

Spyros DOUKAKIS, Michail N. GIANNAKOS, Christos KOILIAS, 

Panayiotis VLAMOS 

Straipsnyje pristatomi apklausos, skirtos istirti studentij pasitikejimq ir elgesj mokantis pagrin- 
dinii} programavimo komandi} ir struktunj rezultatai. Buvo apklausta 116 pirmijjij studijij meti} 
studentij. Rezultatai rodo, kad mokinip supazindinimas su programavimo logika teigiamai veikia 
studentij pasitikejimq ir palankumq siam kursui. Visi matuoti faktoriai yra stipriai susij^. Gauti 
rezultatai rodo, kad ankstesne studento mokymosi kryptis vidurineje mokykloje turi reiksming^ 
jtakq jo pasitikejimui naudoti programavimo komandas ir duomenij strukturas. Vis delto ankstesnis 
mokymasis neturi jokios jtakos studentij pasitikejimui sprendziant uzdavinius ir elgesiui. Apiben- 
drinant tyrimo rezultatus aptariama keletas programavimo kursij problemij. 


